Robust Bounds on Risk-Sensitive Functionals via Rényi Divergence∗

نویسندگان

  • Rami Atar
  • Kenny Chowdhary
  • Paul Dupuis
چکیده

We extend the duality between exponential integrals and relative entropy to a variational formula for exponential integrals involving the Rényi divergence. This formula characterizes the dependence of risk-sensitive functionals to perturbations in the underlying distribution. It also shows that perturbations of related quantities determined by tail behavior, such as probabilities of rare events, can be bounded in terms of the Rényi divergence. The characterization gives rise to tight upper and lower bounds that are meaningful for all values of a large deviation scaling parameter, allowing one to quantify in explicit terms the robustness of risk-sensitive costs. As applications we consider problems of uncertainty quantification when aspects of the model are not fully known, as well their use in bounding tail properties of an intractable model in terms of a tractable one.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Estimation of Rényi Information Divergence via Pruned Minimal Spanning Trees

In this paper we develop robust estimators of the Rényi information divergence (I-divergence) given a reference distribution and a random sample from an unknown distribution. Estimation is performed by constructing a minimal spanning tree (MST) passing through the random sample points and applying a change of measure which flattens the reference distribution. In a mixture model where the refere...

متن کامل

Image Registration and Segmentation by Maximizing the Jensen-Rényi Divergence

Information theoretic measures provide quantitative entropic divergences between two probability distributions or data sets. In this paper, we analyze the theoretical properties of the Jensen-Rényi divergence which is defined between any arbitrary number of probability distributions. Using the theory of majorization, we derive its maximum value, and also some performance upper bounds in terms o...

متن کامل

Risk-sensitive performance criteria and robustness of quantum systems with a relative entropy description of state uncertainty

This paper considers links between the original risk-sensitive performance criterion for quantum control systems and its recent quadratic-exponential counterpart. We discuss a connection between the minimization of these cost functionals and robustness with respect to uncertainty in system-environment quantum states whose deviation from a nominal state is described in terms of the quantum relat...

متن کامل

Compound Poisson Approximation via Information Functionals

An information-theoretic development is given for the problem of compound Poisson approximation, which parallels earlier treatments for Gaussian and Poisson approximation. Nonasymptotic bounds are derived for the distance between the distribution of a sum of independent integervalued random variables and an appropriately chosen compound Poisson law. In the case where all summands have the same ...

متن کامل

Concentration Inequalities for Density Functionals

Estimating various kinds of entropy, mutual information, divergence, and other kinds of integral functionals of probability densities in a statistically consistent manner is of great importance in many machine learning tasks. Although this is a fundamental problem in nonparametric statistics, to the best of our knowledge there have been no finite sample exponential concentration bounds derived ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015